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Abstract 

A special class of preferences, given by a directed acyclic graph, is considered. 
They are represented by incomplete pairwise comparison matrices as only partial 
information is available; for some pairs no comparison is given in the graph. A 
weighting method satisfies the linear order preservation property if it always results 
in a ranking such that an alternative directly preferred to another does not have 
a lower rank. We study whether two procedures, the Eigenvector Method and 
the Logarithmic Least Squares Method meet this axiom. Both weighting methods 
break linear order preservation, moreover, the ranking according to the Eigenvector 
Method depends on the incomplete pairwise comparison representation chosen. 
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1 Introduction 

Pairwise comparisons are widely used in multi-attribute decision making since Saaty pub¬ 
lished the AHP method [l^ . It is assumed that decision makers give a numerical answer 
to the question ’How many times is the ith alternative more important/better/favorable 
than the jth?’, which are incorporated into a matrix with an appropriate size. 

Let M/: denote the positive orthant of the n-dimensional Euclidean space and 
denote the set of positive matrices of size n x n. 

Definition 1. Pairwise comparison matrix: Matrix A = [aij] G is a pairwise 

comparison matrix if Oji = l/oij for all i,j = 1,2,... ,n. 
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The final aim of the use of pairwise comparisons is to determine a weight vector 
w = [wi] G M” for the alternatives such that Wi/wj somehow approximates a^. 

Definition 2. Consistency. Pairwise comparison matrix A = [oij] is consistent if Oik = 
ttijOjk for all i,j,k = 1 , 2 ,..., n. 


Every consistent pairwise comparison matrix can be associated to a weight vector w 
where Oij = Wi/wj for all i,j = 1,2,... ,n. Vector w is unique up to multiplication by 
positive scalars. 

Pairwise comparison matrices provided by decision makers are usually do not meet the 
consistency condition. In other words, they are inconsistent. Then the real weight vector 
w can only be estimated on the basis of the inconsistent pairwise comparison matrix. A 
number of weighting methods is proposed for this purpose. 

Saaty [l^ used the Perron theorem 11|: a positive matrix has a dominant eigenvalue 
with multiplicity one and an associated strictly positive (right) eigenvector. 


Definition 3. Eigenvector Method [EM) 0: EM gives the weight vector w^^(A) G 
M” for any pairwise comparison matrix A such that 


Aw^^(A) = A^a.w^^(A), 


where Amax denotes the maximal eigenvalue, also known as Perron eigenvalue, of matrix 

A. 


Distance-minimization techniques minimize the function d{(^ijjWi/wj), where 

d{aij, Wi/wj) is some sort of a distance of from its approximation Wi/wj. The following 
is an important example with d{aij,Wi/wj) = [logOjj — log {wi/wj)]^. 

Definition 4. Logarithmic Least Squares Method (LLSM) 0 i; 0: LLSM gives the 
weight vector w^^‘^^(A) G M” for any pairwise comparison matrix A as the optimal 
solution of the problem: 


n n 

min 


log Oij - log f — 


1 2 


It may also happen that some pairwise comparisons are unknown due to the lack of 
available data, uncertain evaluationSjOr other problems. Incomplete pairwise comparison 
matrices were introduced in Barker [7|. 

Definition 5. Incomplete pairwise comparison matrix: Matrix A = [oij] of size n x n 
is an incomplete pairwise comparison matrix if an = 1 for alH = 1, 2,..., n, and for all 
i 7^ j, Oji = l/oij G M+ or both a^- and Oji are missing. 

Notation 1. Missing elements of pairwise comparison matrices are denoted by *. 


Example 1. The following pairwise comparison matrix of size 4 x 4 is incomplete: 


( 1 

* 

^13 

Ol4 ^ 

* 

1 

023 

* 

1/fll3 

1/ ^23 

1 

O34 

V l/ai4 

* 

1/O34 

1 / 


2 








Generalization of EM to incomplete pairwise comparison matrices reqnires some com¬ 
ment on measnring inconsistency. Saaty [l^ defined the CR index as 


CR{A) = 


(Amax(A) - n) /{n - 1) _ Amax(A) - fl 


where A”^” denotes the average value of the maximal eigenvalue of randomly generated 
pairwise comparison matrices of size nxn such that each element aij, i < j is chosen from 
the set {1/9; 1/8;. ..; 1/2; 1; 2;...; 8; 9} with equal probability. CR{A) is a positive linear 
transformation of Amax(A). CR{A) > 0 and CR{A) = 0 if and only if A is consistent. 
Saaty recommended the rule of acceptability CR < 0.1. 


to intro- 


The idea that larger Amax indicates higher (CR) inconsistency led 0; Q 
duce variables for missing elements, arranged in vector x and consider the eigenvalue 
optimization problem 


min Ar 

x>0 


.(A(x)) 


in order to hnd a completion that minimizes the maximal eigenvalue, or, equivalently, 
CR. 

Extension of distance-based weighting methods to the incomplete case seems to be 
straightforward: when calculat ing the optimal weights, only the known terms are consid¬ 
ered in the objective function [l0|; |^. 

Bozoki et ah discuss the question of uniqueness of the optimal solution for EM 
and LLSM in the incomplete case, solve the LLSM problem^ and propose an algorithm 
for Ending the best completion of an incomplete pairwise comparison matrix according to 
EM. We will use their results extensively. 

This paper investigates a special class of preferences described by incomplete pairwise 
comparison matrices (Section [2]), for which some natural rankings of the alternatives exist. 
Section [3] reveals that LLSM does not result in one of these orders. Section 0] presents 
that EM does not meet the required condition either. Moreover, the ranking depends on 
the representation chosen. These are the main results of our paper. Finally, in Section O 
we pose some related questions. 


2 Linear order preservation 

Sometimes the decision maker can only provide an ordinal information such as the ith 
alternative is preferred to the jth jl; [^. In this model, incomplete pairs (missing com¬ 
parisons) are allowed but draws are excluded: when the zth and the jth alternatives have 
been compared, the zth or the jth is preferred to the other. 

Definition 6. Ordinal pairwise comparison matrix-. Incomplete pairwise comparison ma¬ 
trix A = [oij] of size n X n is an ordinal pairwise comparison matrix if an = 1 for all 
i = 1,2, ... ,77,, and for all i ^ j, Oij G (6; 1/6} or both Oij and a^i are missing. A real 
number 6 > 1 is an arbitrarily fixed. 

Note that the value 6 > 1 corresponds to the (strict) preference relation between the 
alternatives. 

Ordinal pairwise comparison matrices can be represented by directed graphs. Let 
A be an ordinal pairwise comparison matrix of size nxn. Then G := (V, E) where 

^ See also Kaiser and Serlin Q. 
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ttij — 


V = {l,2,...,n}, the vertices correspond to the alternatives, and E = {e{i,j) 
b, i ^ j}, there is a directed edge from vertex i to vertex j if and only if the ith alternative 
is preferred to the jth. The directed graph associated to an ordinal pairwise comparison 
matrix A is independent of the value 6 > 1. 

Note that different choice of the parameter 6 > 1 is equivalent to taking a correspond¬ 
ing element-wise (positive) power of A. In other words, the associated directed graph is 
the same for every A^^^ = ah , h > 0. 


Definition 7. Weak connectedness: Let A = [oij] be an ordinal pairwise comparison 
matrix of size n x n. The directed graph associated to A is weakly connected if for all 
k,i = 1,2,... ,n, there exists a sequence of alternatives k = mo,mi,...,mt_i ,mt = i 
such that Oms-ims is known for all s = 1, 2 ..., t. 


In an ordinal pairwise comparison matrix represented by a weakly connected directed 
graph, all alternatives are compared directly or indirectly (i.e. through other alternatives). 

Definition 8. Existence of a linear order of the alternatives: Let A = [a^] be an ordinal 
pairwise comparison matrix of size n x n. There exists a linear order of the alternatives 
if there is a permutation a : {1; 2;...; n} —>• {1; 2;...; n} on the set of alternatives such 
that C = [cij] is the permuted ordinal pairwise comparison matrix given by Cij = 
for alH, j = 1, 2,..., n and c^- =h ii i < j and c^- is known. 

Existence of a linear order of the alternatives means that the ordinal pairwise compar¬ 
ison matrix can be permuted such that every known value above the diagonal is 6 > 1. 
Regarding the directed graph representation, it is equivalent to acyclicity. 

The following condition concerns the weighting methods for ordinal pairwise compari¬ 
son matrices. A similar requirement, called Condition of Order Preservation (COP), was 
introduced by Sana e Costa and Vansnick [l|. However, it is dehned on complete pairwise 
comparison matrices and takes into account the intensity of preferences. 


Definition 9. Linear order preservation (LOP): Let A = [oij] be an ordinal pairwise 
comparison matrix of size n x n such that there exists a linear order of the alternatives. 
It can be assumed without loss of generality that Oij = h li i < j and Oij is known. A 
weighting method associating a vector w(A) G M” to A satishes linear order preservation 
if Wi{A) > Wj{A) for all i < j such that Oij is known {oij = h). 

In an ordinal pairwise comparison matrix exhibiting a linear order of the alternatives, 
there exist some ’natural rankings’. Linear order preservation requires that the ranking 
according to the weighting method examined always corresponds to one of them. 

Note that a weighting method associating the same weight for each alternative meets 
the property LOP. 


3 Linear order preservation and the Logarithmic 
Least Squares Method 

In this section it will be scrutinized whether LLSM satishes the property LOP. 
Notation 2. y(A) G M" is given by yi{A) = \ogwf^^^{A) for alH = 1, 2,..., n. 
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Proposition 1. Let A = [a^] be an ordinal pairwise comparison matrix of size n x n. 
Vector (A) is unique if and only if the directed graph associated to A is weakly 

connected. Then the ranking of alternatives is independent of the value ofb>l, that is, 

^LL5M(a) > ^ ^^(A(")) 


for all i,j = 1,2,... ,n and h > 0, where 

Proof. The necessary and snfficient condition for nniqueness is given by Bozoki et al. [2, 
Theorem 4]. 


y(A) = D(A)r(A) where r(A) = Y.,. 


j:aij\s known 


log a. 




M”, so r(A’^^)) = hr (A) and 
D(A) depends only on the positions of known comparisons bnt is not affected by their 
values P, Remark 3]. Therefore y(A(^)) = hy(A), which proves Proposition [H □ 


Since linear order preservation is based on the directed acyclic graph representation 
of an ordinal pairwise comparison matrix, Proposition [T] states that it is meaningful to 
question whether LLSM satisfies LOP. 


Corollary 1. It does not depend on the choice ofb > 1 whether LLSM satisfies LOP or 
not. In other words, LLSM gives the same ranking for every ordinal pairwise comparison 
matrix associated to a given directed acyclic graph. 


Intuition appears to suggest that LLSM satisfies LOP. The first of our main results 
contradicts this expectation. 


Theorem 1. LLSM may violate LOP. 
Proof. It is provided by Example [21 


Figure 1: The directed acyclic graph of Example [2] 
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Example 2. Consider the directed acyclic graph on Figure [H The associated ordinal 
pairwise comparison matrix A is as follows: 


A = 



1/6 
V 1/& 


6 

1 

1/6 

1/6 

* 

* 

* 


6 

1 

1/6 

1/6 

* 

* 


* * 66 ^ 

6 * 

6 6 * * 

1 6 6 * 

1/6166 
1/6 1/6 1 * 

* 1/6 * 1 y 


where 6 > 1. 

In Example El property LOP is satished if wi(A) > W 2 {A), wi(A) > wq{A), tci(A) > 
Wt{A) as well as tCj(A) > t(;j+i(A) and Wj(A) > ii;j+ 2 (A) for all i = 2,3, 4, 5. 

However, LLSM results in 


y(A) 


34 36 24 1 -14 -42 -39 


log 6/49, 


namely, (A) < (A), in contradiction with preservation of linear order. □ 

Remark 1. Example El is minimal regarding the number of alternatives (7) and among 
them, with respect to the number of known comparisons (11) H However, there exist 
more than ten examples with 7 alternatives, and some of them contain only 11 known 
comparisons. 

Remark 2. There exist some examples to Theorem [T] with 8 alternatives and 10 known 
comparisons. Two of them are presented in Example El 


Figure 2: The directed acyclic graphs of Example El 
(a) Graph of matrix A (b) Graph of matrix A! 




^ It can be verified by brute force, examining all ordinal pairwise comparison matrices up to size 
6x6. It is possible because of Corollary[Tl which implies that comparisons above the diagonal may have 
essentially two Values’, known or missing. There exist 2^^ = 32 768 acyclic directed graphs of size 6x6. 
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Example 3. Consider the directed acyclic graphs on Figure Eland the associated ordinal 
pairwise comparison matrices A and A'. LLSM gives 


y(A) = 


95 103 43 43 -17 -65 -113 


1 T 


log 6/128, and 


y(A') = 


71 95 47 -1 7 -53 -53 


-113 


n T 


log 6/128, 


where < W 2 ^^^{A) and {A') < {A'), in contradiction with 

preservation of linear order. 


The violation of LOP can be arbitrarily ’strong’, regarding the difference of the weights 
of the alternatives involved. 


Theorem 2. For every K G M+ there exists an ordinal pairwise comparison matrix 
A = [aij] exhibiting a linear order of the alternatives with a given 6 > 1 such that aij is 
known and < —K for some i < j. 

Proof. It is provided by Example E] for any k>2. 

Figure 3: The directed acyclic graph of Example E] 



Notation 3. Let S and T be two sets of nodes in a directed acyclic graph. S' —)■ T if and 
only if there exists an edge from every vertex i E S to every vertex j E T. 

Example 4. Consider the family of directed acyclic graphs with n = km + 2 vertices 
where Ci = {(* —l)/c + 3, (z —l)A; + 4,..., zfc + 2} for alH = 1, 2,... m (so Ci has k elements) 
such that the edges are given by { 1 } —)■ { 2 }, { 1 } —)■ Cm, { 2 } —)■ Ci and C* -E- Cj+i for all 
i = 1, 2,... m — 1. Figure [3] shows a member of this family if A; = 2 and m = 3, that is. 
Cl = {3,4}, Cl = {5, 6 } and C 3 = {7, 8 }. 

The directed graphs of Example El are weakly connected for any pair of k and m. 
LLSM weights can be obtained as the solution of the following system of linear equations 
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(note that alternatives of Ci have the same weight yci since the LLSM weight vector is 
unique and alternatives of Ct are symmetric): 


{k + l)yi - 2/2 - kyc^ 

— k + l] 

(for the 1st alternative) 

(1) 

{k + l)t/2 - 2/1 - %Ci 

= k — 1] 

(for the 2nd alternative) 

(2) 

{k + l)t/ci - 2/2 - kyc2 

= k — 1] 

(for alternatives in Ci) 

(3) 


2kyci - kyci-i - kyc,+i = 0; (for alternatives in Q, i = 2, 3,... m - 1) (4) 

{k + l)ycm - yi - kycm-i = -{k+l). (for alternatives in (5) 

For instance, the 2nd alternative has k + l known comparisons: with the hrst, and with 
all k alternatives of Ci, and the 2nd is preferred in the latter k of these. The derivation 
can be found in Bozoki et ah [^. 

Subtract ([2]) from ([T]) in order to get 

{k + 2) - y2) - k iyc^ - yc^) = 2. (6) 

The difference of equations ([2D and ([2D gives, 

[yc^-ycm) - {y2-yi)-k{yc^-yc^)-k(yc^-yc^_^) = 2k. (7) 

It follows from equations ([ID that 

ycm. ~ ycl fQ-. 

yc2 - yci = ycs - yc2 = ■ ■ ■ = ycm - yc^-i = -^—• ( 8 ) 

m — 1 

Equations ([7D and ([HD lead to 

2k 

{yci - ycj - ( 2/2 - 2 / 1 ) +-p ( 2 /C 1 - ycj = 2/c, 

m — 1 

which results in 

777- — 1 

2/Ci - yc,^ = 2k + rn-l ^ ‘ 

Substituting ([HD into ([HD gives 

{k + 2) {yi - j/ 2 ) = 2 - /c {yc, - ycJ = 2 - ^ ~ ‘ 

After some calculation we infer 

{k + 2)(2fc + m — 1) {yi — 7 / 2 ) = 4/c + 2m — 2 — 2k‘^{m — 1) — k{m — 1) (r /2 — 2 / 1 ); 
(2k‘^ + Ak + 2m — 2^ {yi — 7 / 2 ) = —2k‘^{m — 1) + Ak + 2m — 2. 

It means that 

—k‘^{m — l) + 2k + m — l 
k"^ + 2k + m — 1 ’ 

so lim„^_ 5 .oo ( 2/1 — + 2 ) = —CX3 for any k > 2. Hence — can be arbitrarily large 

independent of 6a □ 

Remark 3. In Example [H > 0 if fc = 2 and m = 2 (so there are 6 

alternatives), but < 0 if fc = 3 and m = 2 or k = 2 and m = 3 (so 

there are 8 alternatives with 13 and 16 known comparisons, respectively). This family of 
directed acyclic graphs does not give an example with 7 alternatives as Example El does. 


^ It is trivial if b can vary as log 6 may also be arbitrarily large. 








4 Linear order preservation and the Eigenvector 
Method 


In this section we examine whether EM satisfies the property LOP or not. 

Proposition 2. Let A = [aij] be an ordinal pairwise comparison matrix. Vector [A) 
is unique if and only if the directed graph associated to A is weakly connected. 

Proof. See Bozoki et ah [3, Theorem 2], □ 

Theorem 3. EM may violate LOP. 

Proof. Consider the directed acyclic graph on Figure O An associated ordinal pairwise 
comparison matrix A is as follows: 

t 1 3 * * * *33'' 

1/31 3 3 * *** 

* 1/3 1 * 3 3 * * 

*1/3* 1 3 3** 

* * 1/3 1/3 1 *33' 

* * 1/3 1/3 * 13 3 

1/3 * * * 1/3 1/3 1 * 

y 1/3 * * * 1/3 1/3 * 1 y 

Property LOP is satisfied if Wi{A) > W 2 {A), tCi(A) > wji^A), tCi(A) > ws{A), 
W 2 {A) > ws^A), W 2 {A) > tC 4 (A) as well as Wj(A) > Wj{A) for all i = 3,4 and j = 5,6; 
i = 5,6 and j = 7, 8. 

However, EM results in 


w^^(A) 


0.2404 0.2442 0.1481 0.1481 0.0729 0.0729 0.0367 0.0367 


that is, wf^{A) < W 2 ^{A), in contradiction with preservation of linear order. □ 

A parallel of Corollary [T] is not true in the case of EM, it may give a different rank¬ 
ing for a certain ordinal pairwise comparison matrix corresponding to the same directed 
acyclic graph. 

Proposition 3. Let A = [aij] be an ordinal pairwise comparison matrix representing a 
directed acyclic graph. The ranking of the alternatives according to EM depends on the 
value of b > 1. 

Proof. Consider the directed acyclic graph on Figure[31 Besides A, another representation 
by ordinal pairwise comparison matrix A' is as follows: 

/I 4 * * * *44\ 

1/4 1 4 4 * * * * 

* 1/4 1 * 4 4 * * 

, _ * 1/4 * 1 4 4 * * 

* * 1/4 1/4 1 * 4 4 ■ 

* * 1/4 1/4 * 14 4 

1/4 * * * 1/4 1/4 1 * 

1/4 * * * 1/4 1/4 * 1 y 
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EM gives 


w^^(A') 


0.2828 0.2656 0.1404 0.1404 0.0594 0.0594 0.0260 0.0260 


thus wf^(A) < W 2 ^{A) but wf^(A') > w|'^(A'), which verihes Propositional □ 

Note that Proposition [3] does not necessarily mean the violation of linear order preser¬ 
vation if the Qij is missing. For instance, the relative ranking of alternatives 6 and 7 can 
be arbitrary in Example [H 

Remark 4. There exists an example with 6 alternatives and 5 known comparisons (which 
is minimal provided weak connectedness) demonstrating Proposition [31 It is the smallest 
in the number of alternatives. 

The sensitivity of the ranking of the alternatives by EM to the choice of 6 > 1 was 
observed by Genest et ah for certain complete pairwise comparison matrices. 


5 Conclusion 

Logarithmic Least Squares Method seems to give a counter-intuitive ranking of the alterna¬ 
tives for some incomplete pairwise comparison matrices representing preferences described 
by a directed acyclic graph. The ranking according to the Eigenvector Method may also 
contradict to the natural ranking order, while it depends on the correspondence chosen 
for these preferences, too. 

Our results open at least three topics for future research: 

1. How can one characterize the set of ordinal pairwise comparison matrices with a 
linear order of the alternatives for which LLSM obeys LOP'S 

2. When does an unambiguous ranking of the alternatives according to EM exist (on 
the class of preferences given by a directed acyclic graph)? 

3. Which weighting methods perform well with respect to the condition LOPl 
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